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Abstract: This paper considers the Linear Minimum Variance recursive state estimation for 
the linear discrete time dynamic system with random state transition and measurement matrices, 
i.e., random parameter matrices Kalman filtering. It is shown that such system can be converted 
to a linear dynamic system with deterministic parameter matrices but state-dependent process and 
measurement noises. It is proved that under mild conditions, the recursive state estimation of 
this system is still of the form of a modified Kalman filtering. More importantly, this result can 
be applied to Kalman filtering with uncertain observations as well as randomly variant dynamic 
systems with multiple models. 
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1 Introduction 



Linear discrete time system with random state transition and observation matrices arise in many 

areas such as radar control, missile track estimation, satellite navigation, digital control of chemical 

processes, economic systems. Koning pQj gave the Linear Minimum Variance recursive estimation 

formulae for the linear discrete time dynamic system with random state transition and measurement 

matrices without rigorous derivation. Such system can be converted to a linear dynamic system with 

deterministic parameter matrices and state-dependent process and measurement noises. Therefore, 

the conditions of standard Kalman Filtering are violated and the recursive formulae (for example, in 
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PQ) can not be derived directly from the Kalman Filtering Theory. A rigorous analysis in this paper 
shows that under mild conditions, the converted system still satisfies the conditions of standard 
Kalman Filtering; therefore, the recursive state estimation of this system is still of the form of a 
modified Kalman filtering. 

More importantly, this result can be applied to many practical problems related to Kalman 
filtering. Recently, the Kalman filtering with uncertain observation attracted extensive attentions 
[Uls3in]- There are two types of uncertain observations in practice. The first one is that the estimator 
can exactly know whether the observation fully or partially contains the signal to be estimated, or 
just contains noise alone (for example, see jjj). By directly using the optimal estimation theory, 
the Kalman filter for the first type of uncertain observations can be derived easily. The other 
uncertain observations belong to the second type, i.e., the estimator cannot know whether the 
observation fully or partially contains the signal to be estimated, or just contains noise alone, but 
the occurrence probabilities of each case is known. By applying the random measurement matrix 
Kalman filtering, we can derive the Kalman filter with the second type of uncertain observations, 
which is more general than that in [1J |S] . 

On the other hand, in practical applications, people may face a Multi-Model(MM) Dynamic 
Process very often. The MM Dynamic Process is best described in terms of randomly variant 
dynamic systems. Such a system is one that can be suitably described in a hybrid space R Ux x S, 
the Cartesian product of the continuous-valued base state space R Hx and a discrete finite set S, 
the collection of the finite system modes which characterize the behavior patterns of the system. A 
randomly variant dynamic system thus distinguishes itself from conventional systems in its imbed- 
ded random jump process which governs the random transition of its system behavior patterns. 
Many real-world problems can be successfully formulated in terms of such systems. Typical exam- 
ples can be found in systems subject to piecewise linearization of nonlinear systems, maneuvering 
target tracking, reconfigurable systems, etc. The MM dynamic process were considered by many 
researchers (for example, see |7]-|11|). Although the possible models there are quite general and 
possibly depend on the state, only suboptimal algorithms were proposed in the past a few decades. 
However, some of the MM systems, although they are not dependent on the state and somewhat 
restrictive than the the models considered in [SJ^j, can be reduced to the dynamic models with 
random transition matrix, therefore, the optimal filter can be given directly according to the random 
transition matrix Kalman filtering given here. The simulation results support the analysis in this 
paper. 

The remainder of this paper is organized as follows. In Section 2, we present the random param- 
eter matrices Kalman filtering. In Section 3, we formalize a general model of Kalman filtering with 
uncertain observations, and derive the optimum linear recursive estimators by applying the random 
Kalman filtering. And two application examples are provided to give an intuitive understanding 
of the results. In Section 4, we formalize the multiple-model dynamic process as a process with 
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random transition matrix and provide the optimal real-time estimator for this case. In Section 5, 
simulation examples are given for the models given in Section 3 and Section 4. Finally, in Section 
6, we present our conclusions. 



2 Random Parameter Matrices Kalman Filtering 

Consider a discrete time dynamic system 

x fe+ i = F fc x fc + v k , (1) 

y k = H k x k + u k , k = 0, 1, 2, • • • , (2) 

where x^ £ 1Z T is the system state, y k E TZ is the measurement, v k € lZ r is the process noise, and 
oj k G 1Z N is the measurement noise. The subscript k is the time index. F k G 7£ rxr and H k G j^ Nxr 
are random matrices. 

We assume the system has the following statistical properties: {F k , H k , v k , u) k , k = 0, 1,2, • • •} 
are all sequences of independent random variables temporally and across sequences as well as in- 
dependent of x . Moreover, we assume x k and {F k , H k , k = 0, 1,2, • • •} are independent mutually. 
The initial state xo, the noises u k , uj k , and the parameter matrices F k , H k have the following means 
and covariances 

T 

E(xq) = no, £(x - /x )(x - /i ) ~Po, (3) 
E{u k ) = 0, E(y k v T k ) = R Uk , E(u k ) = 0, E{uo k J k ) = i^ fc , (4) 
E(F k )=F k , Cov(f^,f^ n ) = C fh& (5) 
= i? fe , Co^/i*, O = C hk . hkmn , (6) 

where and /i^. are th e [i^j^th entries of matrices F k and H k , respectively. 
Rewrite F k and H k as 

F k = F k + F k , (7) 
H k = H k + H k . (8) 
Substituting Q, (|SJ) into (Q), @ converts the original system to 

Xfc+i = F k yi k + z> fc , (9) 

y k = H k ^ k + Cb k , (10) 



where 

£fc = ^fc + F k x k 



(11) 
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System Q, (fTU)) has deterministic parameter matrices, but the process noise and observation noise 
are dependent on the state; therefore, this would not satisfy the well-known assumptions of standard 
Kalman filtering. 

In the following, we will derive the recursive state estimate of the new system, which is of the 
form of a modified Kalman filtering. We present two lemmas first, and leave their proofs in the 
appendix of the paper. 

Lemma 1. Suppose random matrix F and random vector x are independent, then 

E(Fxx T F T ) = E(FE(xx)F T ) 

Lemma 2. 

(a) E(v k ) = 0, E{u k ) = 0; 

(61) E(x 9 T k ) = 0, (62) £(x cDfc ) = 0; 

(cl) E(D k Di) = 0, (c2) E(u k {vl) = 0, (c3) E{y k ^) = V k ^ I; 

T T 

(d) E(v k v k ) = Rp k , E(iu k Lu k ) = Rcj k , 

where 

Rz k = R Vk + E(F k E{K k x k )Fl), 
Ru, k =Ru> k +E{H k E{^ T k )H T k ). 

By Lemma 2, system 0, IJlOj) satisfies all conditions of the standard Kalman Filtering. Hence, 
we have the following theorem (012]) immediately. 

Theorem 1. The Linear Minimum Variance recursive state estimation of system ©, (llUj) is given 
by 



x fc+llfc+l 


— x k+l\k + K k+l{Vk+l - Hk+l*k+l\k) 


X fe+1|A; 


= Fk*k\k 


K k +i 


— T . — — T 

= Pk+i^Hk+iiHk+iPk+i^Hk+i + Pu k 


Pk+l\k 


= F k P k F T k +R Dk 


Pk+l 


= (I - K k+ iH k+ i)P k+1 \ k 


R i>k 


= R Vk +E{F k E{ W T k )F T k ) 


Rv k 


= R„ k + E(H k E{ W T k )H T k ) 



4 



£(x fe+lX fc +1 ) = F k E{-K k ^l)F T k +E(F k E{ W T k )Fl)+R Vk 

T T 

x | = Exq, P = Wzr(x ), £(x x ) = £x £x + P , 
where the superscript " + " denotes the Moore— Penrose pseudo inverse. 

Remark 1. Compared with the standard Kalman filtering, random parameter matrices Kalman 
filtering has one more recursion of E(x. k+ i~K k+1 ). By Theorem 1, we eventually have to compute 
E(Fj c E( m x.j c ^. k )F k ) and E(Hf e E(-Kf c ^ k )H k ) and their analytical expressions are given as: 

~ T ~ T 

E(F k E(x k x k )F k ) { 

m,n) 

rr r 

= > C f k f k Xj-t + > C f k fk Xao + •••+> C tk tk X ir , m, n = 1, 2, • • • , r 

i=l i=l i=l 



~ T ~ T 

E(H k E(-x k x k )H k )( mi „) 

r r 

E n yk I \ /~i yk 

U h k ,h k .^il ~+~ Ly h k h k A i2 
nl mi ' - n2 mi 

i=l i=l 

where X = E(-x k x. k ). 



r 

■■■ + Y J C hk h k Xl, m,n = l,2,---,N 

1 = 1 



3 Application to A General Uncertain Observation 

Consider a system 

Xfc+i = F k x k + u k (12) 
l i 

Yk = E -f{ 7 (fc)=i}#i.Xfc + E -^{ 7 (fc)=i} a; fc' ( 13 ) 
1=1 1=1 

where all the parameter matrices are non-random and a set of multiple observation equations is 
selected to represent the possible observation case at each time. The random variable 7^ is defined 
to formulate which measurement matrix is chosen at time k and the value of 7^ is either observable 
or unobservable. If 7^ = i, the measurement matrix is H k and the observation noise corresponds to 
uj\. When the value of 7^ is observable at each time k, this is an uncertain observation of the first 
type and the state estimation with measurement equation (|13f) is converted to 

y fc = #!x fc + u4, (14) 

which is obviously the classical Kalman filtering, i.e., the least mean square estimate using the 
various available observation of y^. To show the applications of the random measurement matrix 
Kalman filtering, we focus on the the second type of uncertain observations, i.e., in (|13JI . 7^ is 
unobservable at each time k, but the probability of the occurrence of every available measurement 
matrix is known. 
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Consider that in 7^ is unobservable at each time k, but the probability of the occurrence 
of each measurement matrix is known. Obviously, © is a more general form of (|13|) because 
only expectation and covariance of H k in are known (see ([fi])) other than its distribution. The 
expectation of H k can be expressed as: 

Hk = jZpiH (15) 
i=l 

Hl = Hi- H k , with probability (16) 

The remainder in order to apply the random measurement matrix Kalman filtering is just to calcu- 
late: 

l 

Rz k = + E{H k E( W T k )Hl) = R Uk + - H k )E{-x k * T k ){Hi - H k f (17) 

i=i 

Substituting (|15l) and (|17|) into Theorem 1 can immediately obtain the random measurement ma- 
trix Kalman filtering of model ([T|). (|13|). In the following, two specific examples of the uncertain 
observations of the above model 0, (|13|) are given. 

Example 1. 

In the classical Kalman filtering problem, the observation is always assumed to contain the signal 
to be estimated. However, in practice, certain observation may contain noise alone, and the estima- 
tor cannot know this happens, only the probability of occurrence of such cases being available to 
the estimator. Nahi[I] derived the optimal recursive estimator with uncertain observation, but it is 
easy to see his result is a special case of ours except some notation difference. 

Consider such a discrete dynamic process x k ,k = 0,1, ■ ■ ■ is defined by 

Xfe+i = FfeXfc + v k , (18) 

where F k is a non-random matrix of appropriate dimension and v k is a noise sequence satisfying 

E(v k ) = (19) 
E{v k v*) = R Uk 5{k-l). (20) 

<5(-) is the Kronecker delta function. The initial state xo is assumed to be a random vector with a 
known mean hq and a known covariance matrix i-fa- 

The observation is given by 

y k = h k x k + (jj k , with probability p{k) 

(21) 

= u k , with probability 1 —p(k), 
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where h k is also an non-random matrix, uj k is the observation noise satisfying 

E(u k ) = (22) 
E(u; k iol) = R^Jik-l). (23) 

p(k) is the probability that the kth observation contains the signal x^. Hence, the above observation 
can be described equivalently by 

y k = H k x k + uj k (24) 

where the observation matrix H k is a binary-valued random matrix, with 

Pr{H k = h k } = p(k) (25) 

Pr{H k = 0} = l-p(k) (26) 

Due to ©, 

H k = p(k) h k (27) 

Pr{H k = (l-p{k)) h k }=p{k) 

Pr{H k = -p{k) h k } = 1 - p{k) 
In the uncertain observation case, the state transition matrix is still a constant one, but the mea- 
surement matrix is random, by (|27|) and (|28|) . the covariance of the process and observation noise 
can be written as follows: 



Rv k = Ru k (29) 

and 

Ra h = Ru k + E(H k E(x k xl)H^) = R Wk + (1 - p{k))p{k)h k E{x k yL T k )h T k . (30) 

Thus, the random measurement matrix Kalman Filtering in this special case is given by: 

x k+ i\ k+ i = x k+1 \ k + K k+1 (y k+1 - p(k + l)h k+1 x k+1 \ k ) 

%k+i\k = E k x k \ k 

K k+ i = p(k + l)P k+1 \ k hl +1 { p{k + lfh k+ iP k+l \ k hl +1 + R^ k ) + 

Pk+i\k = E k P k F k + R Uk 

P k+ i = (I - p{k + l)K k+1 h k+1 )P k+1 \ k 

Rw k = Ru, k + (1 - p(k))p(k)h k E(x k xl)h k 

E{x k+1 x T k+l ) = F k E{x k x T k )Fl + R Vk 

x | = E(x ), P Q = Var(x ),E(x XQ) = E(x )E(xq) + P . 
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Compared the above formulas with Nahi's result @], it is easy to see his result is a special case of 
ours except some notation difference. 



Example 2. 

We assume has at least two elements and partition y k into multiple parts, each part may 
contain noise alone. In the simplest case, suppose y^ is divided into two parts y/c,i,yfc,2- The 
observation equation can be given by: 



yfc,i 



Hk,i \ ( 
x fc + 

Hk,2 ) \ w fc,2 



(31) 



where the observation matrix H k i, i = 1,2 are independent of each other and two binary random 
matrices with 

Pr{H k<i = h k ,i} = Pi (k) (32) 
Pr{H k>i = 0} = l- Pi (k) (33) 

Similarly as the derivation as before, we can obtain: 

/ pi(k)hk,i \ 

H k =\ (34) 
and the various samples of H k with their probabilities are given in the following table: 



Sam. of Hu 



-pi(k)h k>1 
-P2(k)h k ,2 



(1 -pi(k))h k ,i 

(1 -P2(k))hk,2 



[1 -pi(k))h k>1 
-P2(k)h kt 2 



-pi(k)h kA 
(1 -P2(k))h k ,2 



Pi 



(l- Pl (k))(l-p 2 (k)) 



P\{k)p 2 {k) 



Pi{k){\ - p 2 {k)) 



[1-Pi(k))p2(k) 



Table 1: Samples of H k with their probabilities 



Therefore, 



Rw k 



R Wk +E{H k E{^ T k )Hl) 



(1 - pi(k))pi(k)hk,iE(x k Xk) h k,i 







(1 - p 2 (k))p 2 (k)h k}2 E(x k x^)hTr 



(35) 



Substituting Q34|) and Q35JI into the Kalman filtering in Theorem 1 can yield the optimum esti- 
mator straightforwardly for system (|18jl. (|31() . 
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4 Application to Multiple-Model Dynamic Process 



The multiple-model (MM) dynamic process were considered by many researchers (for example, see 
Hj jH] ) Although the possible models considered in those papers are quite general and can depend 
on the state, only suboptimal algorithms were proposed in the past a few decades. On the other 
hand, although some of the MM systems are not state-dependent and therefore more restrictive 
than the models considered in [SI E3, but these MM systems can be reduced to dynamic models 
with random transition matrix and thus the optimal real-time filter can be given directly according 
to the random transition matrix Kalman filtering proposed in Theorem 1. 

Consider a system 

Xfc + i = F k x k + v k with probability p l k , i = 1, 2, • • • , I. (36) 
y k = H k x k + io k (37) 

where {F k } and {v k } are independent sequences, and H k is non-random. We use random matrix 
F k to stand for the state transition matrix. The expectation of F k can be expressed as: 

3=1 

F\ = F k — F k , with probability p{ (39) 

A necessary step for implemeting the random Kalman filtering is to calculate 

l 

R 0h = R Uk + E(F k E(x k x k )F k ) = R Vk + 5>|(F| ~ F k )E{x k x T k ){Fl - F k ) T (40) 

i=l 

Thus, all the recursive formulas of random Kalman filtering can be given by: 
x fc+i|fc+i = x k+i\k + K k+ i(y k+ i - H k+ ix k+1 \ k ) 
x fc+i|fc = F k x k \ k 

T T -f- 

Kk+i = Pk+i\kH k+ i{H k+ iP k+1 \ k H k+1 + R Wk ) 

- -T 

Pk+i\k = F k P k F k + Ry k 
Pk+i = (I - K k+ iH k+ i)P k+1 \ k 



Ro k = R Vk +^k{F l k-Fk)E(^ T k){Fl-F } 

i=l 

I 

S(x fe+1 Xfe +1 ) = F k E(x k x k )F k + J2pU4 ~ F k )E(x k y%)(Ft - F k f + R Vk 

i=l 

T T 

x i = Exq, P = Var(x ), -E(x x ) = Ex Ex + P , 
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5 Simulations 



The simulations were done for a dynamic system with random parameter matrices modelled as an 
object movement with process noise and measurement noise on the plane. The two simulations show 
the specific applications of results in the last two sections. 

Simulation 1. We consider the model in example 1, and certain observations may contain noise 
alone, only the probability of occurrence available to the estimator. The object dynamics and 
measurement equations are given by, 

/ cos(2vr/300) sin(2vr/300) \ 
Fu = (41) 
\ -sm(27r/300) cos(2vr/300) / 

H k = ^ | ' With probability 7 = 0,95 ( 42 ) 

= 0, with probability 1 - 7 = 0.05 (43) 

The initial state xo = (50,0), Pq|o = 0.5/. The covariance of the noises are diagonal, given by 
R u = 2, = 1. It is easy to see that the target is a object that moves noisily at constant rotation 
speed 27r/300/step in a circle with initial radius 50 about origin of the coordinate space. Using a 
tracking trajectory and Monte-Carlo method of 50 runs, we can evaluate tracking performance of 
an algorithm by comparing a tracking trajectory with the actual moving object (see Fig.l below) 
and showing the second moment of the tracking error (see Fig. 2 below) given by 



, 50 
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Ek of Random K I- 




Figure 2: Estimated tracking error variance of Random KAL with two measurement equations 

From Figs.l and 2, the tracking performance of the random Kalman filtering looks acceptable, and 
the more simulations have done for the different probabilities of observation 7. The those simulation 
results show that the smaller 7 is, the bigger the tracking error is, which is consistent with intuitive 
expectation. 

Simulation 2. In this simulation, there are three dynamic models , with the corresponding 
probabilities of occurrence available. The object dynamics and measurement equations are given 
by, 



F k = { 



e. = ( ; 

Obviously, for this system, the object at time k moves at three different rotation speeds with the two 
corresponding probabilities, respectively, in a circle with radius ||xfc|| about origin of the coordinate 
space. 



cos(2tt/300) sm(2vr/300) 

-sm(2vr/300) cos(2vr/300) 

cos(2vr/250) sm(27r/250) 

-sm(27r/250) cos(2vr/250) 

cos(2tt/100) sm(2vr/100) 

-sm(2vr/100) cos(2tt/100) 



with probability 0.1, 
with probability 0.2, 
with probability 0.7, 



(44) 



1 

-1 



(45) 
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comparison of true and tracking trajectories 




Figure 3: Tracking trajectory of random KAL with three dynamics equations 



Ek of Random KF 




Figure 4: Estimated tracking error variance of random KAL with three dynamics equations 
From Figs. 3 and 4, it can be shown that the filter given in section 4 does work well. 



6 Conclusion 



In this paper, we have given rigorous analysis for the Linear Minimum Variance recursive state es- 
timation of the linear discrete time dynamic system with random state transition and measurement 
matrices. Since such a system can be converted to a linear dynamic system with deterministic pa- 
rameter matrices and state-dependent process and measurement noises. We have shown that under 
mild conditions, the converted system still satisfies the conditions of standard Kalman Filtering; 
therefore, the recursive state estimation of this system is still of the form of a modified Kalman 
filtering. More importantly, we found that this result can be applied to Kalman filtering with 
uncertain observations as well as randomly variant dynamic systems with multiple models. The 
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simulation examples support our analysis for the applications of the random parameter matrices 
Kalman filtering. 



Appendix 

In this appendix, we provide proofs for the various lemmas that are presented in the paper. 
Proof of Lemma 1. 

By the properties of conditional expectation, we have that 

E(FyLx T F T ) = E(E(Fxx F T \F)) 
= E(FE(xx\F)F T ) 

= E{FE{xx)F T ). (A.l) 

Q.E.D. 

Proof of Lemma 2. 

(a) : By the assumptions on the model Q and ©, and notations in (|11|) . it is obvious. 

(61) : Since {F k , v k , k = 0, 1, 2, . . .} is independent of xo, 

T ~ T 

E{x.oh) = E{x. (v k + F fc x fc ) } 
= E(yL x T k F k ) 

T ~T 

= £ , {x (F fc _ix fc _i + u k -i) F k } 

T T ~ T 

= E{xo (F k -2Xk-2 + Vk-2) F k _ x F k } 

T T T ~ T 

= E(-x x k _ 2 F k _ 2 F k -iF k ) 

= ^(xoXq F F l ■■■ F k _ 2 F k _ 1 F k ) 

= E(x 4)E(FT)E(F?) ■ ■ ■ E(F k _ 2 )E(F k _ 1 )E(F k ) 

= 0. 

(62) : Similarly, E(-x.QU k ) = 0. 

(cl) : Without loss of generality, we consider the case of k > I only. 

E (hi>i) = E{v k uJ + UkKiFf + F k x k u[ + F k x k xJP[) 

For xj is linearly dependent on i 7 )_ 1 F i _ 2 • • • ^l^oxo, ^-1,^-1-^-2 • • • i^-i+i^-i, i = 2, 3, • • • , I, and 
{F k , u k , k = 0, 1, 2, . . .} is independent of xq, 
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E{v k x T iFi) 

— T 

E(F k x k v l ) 







- T 

E{F k {F k -ix.k-i + v k -\)v x } 



- T 

= E(F k F k ^ 1 x k _ 1 u l ) 

- T 

= E{F k F k -i{F k -2^-k-2 + V k -2)V { } 

= E(F k F k ^iF k ^k-2^) + E{F k F k _iv k „ 2 vT) 

= E{F k F k _ 1 ■ ■ ■ F m uJ) + E(F k F k -i ■ ■ ■ F l+1 u t uJ) 
= E(F k )E(F k _i) ■ ■ ■ E(F l+1 )E(w) 

= 0. (A.2) 



Noting that x/ and {F k , k = 0, 1, 2, ■ • •} are independent, we have 



E(F k x k xJ P[) = £{F fc (Ffc_ix fc _i + i/fc_i)x^ T )} 
= £(F fc F fc _ 1 x fc _ 1 x?'^ T ) 

T ~ T ~ T —T 

= F(F k F k _ 1 F k _ 2 x k _ 2 x l F l + F k F k _iv k _2*i F l ) 



= E(F k F k ^F k _ 2 ■ ■ ■ F l+l F m ^Fi ) + E{F k F k ^F k _ 2 ■ ■ ■ F l+m ^F?) 

= E{F k F k _ 1 F k _ 2 ---F l+1 F l yL l x r l Fl) 

= EiFkFk^F^ ■ ■ ■ F l+1 F m ^Fi) + E(F k F k _ 1 F k _ 2 ■ ■ ■ F^F^xJ F? ) 

= E{E{F k F k ^F k . 2 ■ ■ ■ F^FfiEfa^F?) + E(E(F k F k _ 1 F k _ 2 ■ ■ ■ F^i^xpcf )if ) 



Hence, E(y k v l ) = 0. 

(c2) : Also consider the case of k > I only. Since x; is linearly dependent on Fi_\Fi_ 2 ■ ■ ■ F±FqXq, fi-i, 
F1-1F1-2 ■ ■ ■ Fi-i+ivi-i, i = 2,3, •••,/, {F k ,H k , v k , iv k , k = 0,1,2,...} is independent of x , and 
{F k , H k , k = 0, 1, 2, . . .} is independent of x/. Moreover, 



E(u k uJ) = E(u k ujJ + u k xjHi + H k x k Lvl + H k x k xjH?) 

= E(H k x k x*Hi) 

= E{H k {F k -ix k -i + ^_i)x^ T } 

= E^kF^Xk-ixJ Hj) 

= -Ffc-l-Ffc-2Xfc-2X; i?; + H k F k ^\V k ^ 2 X l H l ) 

= F(H k F k _iF k ^ 2 ■ ■ ■ i<j +1 i*jXjXj ^ ) + E{H k F k _iF k _ 2 ■ ■ ■ F t+1 uix t H l ) 



= 0. 



(A.3) 
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E{h&i) = E(v k J { + Vk^iHj + F k x k u;J + F k x k x^H^). 
When k > I, as the derivation in (A. 4), we can obtain, 

T ~ T ~ T 

E{v k u l ) = E(F k x k x l H l ) 

- T - T 

= E{F k (F k _ix k _i + u k -i)x l H l } 
= E(F k F k . lXk _ lX [Hi) 

= E{F k F k ^F k ^k-2X T i Hi) + E(F k F k ^v k ^ H?) 

= E(F k F k _ 1 F k _ 2 ■ ■ ■ Fi +1 F t xix t H l + F k F k _iF k _ 2 • • • i^+i^x, H l ) 
= 0. 



When k < l„ as derivation in (A. 2) and (A. 3), 

E(v k x^H?) = ^{^ fc (^_iXi_i + ^_i) T ^ T } 

= Eiy^^F^Hi) 

= EfayL^F^F^H?) + E{v k Vi_ 2 Fi-iHi) 

= E(v k x k F k F k+1 ■ ■ ■ F^) + E(u k u T k F k+1 ■ ■ ■ F^H?) 

= o, 

E{F kXk ^Hi) = £;{F fc x fc ( J F,_ix,_i + ^_i) T ffi r } 

= E(F k x k xJ_ 1 F^_ 1 H^ ) 

= E{F kXk (Fi^i~2 + 'yi-2) T F[_ l H^} 

= E{F k x k (F k x k + v k ) T Fl +l ■ ■ ■ Fi^Hj} 
= E(F k x k x k F k F k+1 ■ ■ ■ F l _ 1 H l ) 
= E(F k E(x k yL T k )F k E(F k+1 ---Fl_ 1 Hi)) 
= 0. 

Thus, Eiv^) = 0. 
(d): 

Eiy k v T k ) = E(v k v T k + v k x k F T k + F k x k v T k + F k x k x T k F k ) 
= R Uk +E(F k x k x T k F k ) 
= R Uk +E(F k E(x k x T k )F k ) 
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Similarly, E(u> k &l) = + E{H k E{^ k ^ T k )H T k ). 



Q.E.D. 
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